Digital pan, tilt and zoom

ABSTRACT

Video capture systems, methods and computer program products can be provided and configured to capture video sequences of one or more subjects during an activity. The video capture system can be configured to include a communications module that is provided to receive a set of successive frames of video image data of a defined coverage area in an activity location and to receive tracking information indicating a position of the subject in the activity location. A content selection module can be further provided to determine a location of the subject in the defined coverage area based on the tracking information to thereby determine a subset of the image data in one or more received frames, or in a set of frames, of video image data that contains image data of the subject.

RELATED APPLICATIONS

This patent is a continuation of and claims the benefit of U.S.application Ser. No. 11/834,545, filed Aug. 6, 2007, Publication No.2009/0040301, and Ser. No. 11/834,535, filed Aug. 6, 2007, PublicationNo. 2009/0041298, each of which is incorporated herein by reference inits entirety.

TECHNICAL FIELD

The present technology relates to motion video and other content items,and more particularly, some embodiments relate to systems and methodsfor capturing motion content across an environment.

DESCRIPTION OF THE RELATED ART

It is widely believed that the earliest mechanisms for producingtwo-dimensional images in motion, were demonstrated in the 1860s, usingdevices such as the zoetrope and the praxinoscope. These devices wereconfigured to show still pictures in sequence at a speed last enough,that the images on the stills appeared to be moving. This phenomenon wasoften referred to as persistence of vision. This principle ofpersistence of motion provided the foundation for the development offilm animation.

With the advent of celluloid film used in photography, it becamepossible to directly capture objects in motion in real time usingsimilar techniques. Soon thereafter, the motion picture camera allowedthe individual frames, or still images, to be captured on film on areel, which, enhanced the usability of the motion video. This quicklyled to the introduction of the movie projector that provided the abilityto shine light through the processed and printed film, and magnified orprojected these images onto a large screen.

Early motion showed an event or action without editing or other specialeffects. As innovation took hold, new techniques were employed toenhance the enjoyment of the films and the viewing experience overall,for example, one technique strung multiple scenes together so that themoving picture told a story. Another technique evolved to change cameraangles or to include camera movement to further enhance the experience.Also, early motion pictures-were actually ‘silent’ movies in that nosound was captured on the film. Theaters often employed a pianist,organist or even, a number of musicians to add background music to thefilm.

In their earliest forms, motion and still picture cameras were large,cumbersome and specialised, devices that were not practical for use byconsumers at large. Their cost and relative difficulty of use kept themout of the hands of the average consumer. As technology evolved, moresimplified versions of still and motion picture cameras eventuallybecame available. This enabled the general consumers to become moreinvolved in still and motion photography for a number of applicationsand occasions. The eventual ubiquity of the consumer level motion andstill photographic equipment has lead to an even greater popularity ofcontent featuring the users themselves, their friends and their family.Birthdays, family outings, ballet recitals, sporting events, schoolplays, vacations, and countless other events and activities are capturedby participants, viewers and attendees in larger numbers than ever.

One perhaps natural outgrowth of this phenomenon, especially in ourcapitalistic society, is the capture of events for commercial purposes.School plays and musicals are often recorded on film or disk by studentsor other designated individuals, and DVDs of the event are sold to thefamilies of the student thespians. As another example, roller coastersand other thrill rides often feature still cameras to capture an imageof the riders during a more thrilling section of the ride. These imagesare then offered for sale after the ride so that the rider or her familycan keep a picture of the event.

Challenges lacing the recording and capture of such events, however,involve the ability to capture a motion video of one or moreparticipants when such participants axe moving across a large eventarea. For example, consider the challenge facing one attempting tocapture a motion video when the objective is to record a video of askier skiing down a large mountain with several different ski trails. Aroller-coaster type of solution might provide a still snapshot of theskier at a key point on the mountain such as, for example, at a locationwhere there is a jump. One other solution would be to have a livevideographer ski along with the subject skier to ‘manually’ record thevideo of the skier. This solution would be expensive and time consuming,and might not lead to desirable results.

Accordingly, one current solution in the market is for people to taketheir own cameras with them and record their co-participants performing.The disadvantages to this can be numerous. For example: you get no videoof yourself, it can be dangerous to perform many sports while carryingand using the camera, you put the camera at risk of damage, in manysports you can't keep up with the people you want to film or they simplyare not with you all day long, the moving camera and resulting bouncyimage result in a poor video, and most people can't perform, a sport anduse a camera, at the same time. While one or more persons can stand atvarious locations around a ski resort and shoot video all day long itwould be a labor-intensive task to then process the video and split itoff into clips of each participant. As one other alternative, skiresorts offer webcams that provide a “big-picture” view of the action onthe ski slope but generally these tend to be low resolution and lowframe rate cameras.

BRIEF SUMMARY OF EMBODIMENTS OF THE INVENTION

The present invention in one embodiment allows participants tomemorialize the excitement of their activity with a personalized videoor DVD of themselves having fun and performing out on the open terrain.Cameras can be installed at, for example, fixed locations throughout asports park or other venue, and video footage is captured throughout theday. By using tracking technology to locate each tracking enabledathlete, a video can be assembled using portions of each camera's videothat contain that person. In another embodiment, a person may designatemore than one participant whom they would like to include in the videoand a composite video can be created to include ‘footage’ of theidentified participants.

Accordingly, a customer will be able to have their performance trackedall day and then receive a video of their performance. In oneembodiment, the video equipment can be installed and run by the ski park(or other venue management) or a third party provider, and fees can becharged to the participant or other purchaser for the video. The videocan be supplied as an online streaming or downloaded file, or on DVD orother medium that can be picked op at the end of the day, or mailed tothe customer.

The invention is described in terms of the ski resort industry.Additional markets for die invention can include skate board parks, BMXparks and auto race tracks, just to name a few. Video editing tools canbe provided and be made accessible via the web or other communicationsinterface so users can customize their personal videos with backgroundmusic, special effects, and so on, or rearrange clips, zoom images, etc.

According to various embodiments of the invention, a video capturesystem can be provided and configured to capture video sequences of asubject during an activity. In one embodiment, the invention can beconfigured to include a plurality of video cameras positioned atpredetermined locations in an activity area, a tracking deviceconfigured to track a location of the subject during the activity, acontent storage device communicatively coupled to the video capturedevices and configured to store video content received from the videocapture devices, and a content assembly device communicatively coupledto the content storage device and to the tracking device, and configuredto use tracking information from the tracking device to retrieve videosequences of the subject from the tracking device and to assemble theretrieved video sequences into a composite subject video.

The tracking device can further include a position determination moduleconfigured to determine a position of the tracking device; a timingmodule configured to provide timing information corresponding to thedetermined positions; and a communications interface configured tocommunicate time-stamped position information to the content assemblydevice. The time-stamped information can be directly or indirectly timestamped. In one embodiment, the position determination module of thetracking device comprises a GPS module, or triangulation module.

In one embodiment, a video capture system is configured to capture videosequences of a subject during an activity, and includes; a firstcommunication module configured to receive a set of successive frames ofvideo image data of a defined coverage area in an activity location; asecond communication module configured to receive tracking informationindicating a position of the subject in the activity location; a contentselection module coupled to the first and second communication moduleand configured to determine a location of the subject in the definedcoverage area based on the tracking information to thereby determine asubset of the image data in each received frame of video image data thatcontains image data of the subject.

In a further embodiment, the content selection module cub be furtherconfigured to select the determined subset of image data in eachreceived frame and to assemble the selected subsets into a videosequence of the subject. The subset of image data, for example, definesa moving window across the frame. Additionally, different subsets ofimage data can be determined by the content selection module to trackthe subject's movement across the frame. The subset of image data can beselected as a defined sector of the frame. The subset of image data canalso be a range of pixels of a predetermined size. The size of the rangeof pixels can be configured to increase as the subject moves closer tothe video camera.

In another embodiment, the first communication module is configured toreceive image data from a plurality of content capture devices, and eachimage capture device can have a defined coverage area in the activitylocation. The content selection module can be farther configured to usethe tracking information to identify which of the plurality of capturedevices include image data of the subject.

In a further embodiment, the system can be configured to include a videocamera coupled to the first communication module and further configuredto capture the set of successive frames of video image data from thedefined coverage area for that camera.

The video capture system can be configured to include a tracking deviceconfigured to provide the tracking information. In one embodiment, thetracking device can include a position determination module configuredto determine a position of the tracking device; a timing moduleconfigured to provide timing information relating to the determinedpositions; and a communications interface configured to communicatetime-stamped position information to the content assembly device.

In still another embodiment, a method of capturing video content of anactivity subject, includes obtaining a set of successive frames of videoimage data of a defined coverage area in an activity location; obtainingtrucking information indicating a position of the subject in theactivity location; determining a location of the subject in the definedcoverage area based on the tracking information to thereby determine asubset of the image data in each received frame of video image data thatcontains image data of the subject. The method can further includeassembling a plurality of determined subsets into a video sequence ofthe subject. The subset of image data, for example, defines a movingwindow across the frame. Additionally, different subsets of image datacan be determined by the content selection module to track the subject'smovement across the frame. The subset of image data can be selected as adefined sector of the frame. The subset of image data can also be arange of pixels of a predetermined size. The size of the range of pixelscan be configured to increase as the subject moves closer to the videocamera. In a farther embodiment, the method can include identifyingdifferent subsets of image data from a frame of image data in responseto changes in the location of the subject to track movement of thesubject image across the frame.

In a further embodiment, the image data can be stored and assemblingincludes retrieving the identified image data segments from storage forassembly into the video sequence. In yet another embodiment, the videoimage data can be received from a plurality of content capture devices,and each capture device can have a defined coverage area in the activitylocation. Additionally, the method can include correlating the trackinginformation with defined coverage areas to identify which of theplurality of image capture devices include image data of the subject. Inone embodiment, the correlating comprises determining a location of thesubject based on the tracking information; and comparing the determinedlocation with the coverage areas of the plurality of image capturedevices to determine which image capture device captured image data ofthe subject at the determined location. The operations of determining alocation and comparing the determined location with the coverage areascan be repeated for a plurality of subject locations.

In a further embodiment, image data can be stored as image data sets,and the sets can have an associated coverage area and havingascertainable timing information. Timing information associated with thetracking data can be received for the correlation and the correlationcan include: determining a location of the subject based on the trackinginformation; using timing information associated with the trackinginformation to determine a time at which the subject was at thedetermined location; comparing the determined location with the coverageareas of the plurality of image capture devices to determine which imagecapture device captured image data of the subject at the determinedlocation; and using the determined time to identify the image segment orsegments from the determined image capture device that correspond to theidentified time. The identified image data segments can be retrievedfrom storage for assembly into the video sequence.

In still a further embodiment, a method of capturing video content of anactivity subject includes: obtaining a set of frames of image data for adefined coverage area in an activity location; determining locationinformation identifying a plurality of locations of the subject in thecoverage area and a time at which the subject was at each location; foreach location, selecting one of the successive frames of datacorresponding to the time the subject was at that location andidentifying a subset of the image data in the selected frame thatcontains image data of the subject based, on the subject location, inthe coverage area.

The method can further include assembling a plurality of subsets into avideo sequence of the subject. The subset of image data, for example,defines a moving window across the frame. Additionally, differentsubsets of image data can be determined by the content selection moduleto track the subject's movement across the frame. The subset of imagedata can be selected as a defined sector of the frame. The subset ofimage data can also be a range of pixels of a predetermined size. Thesize of the range of pixels can be configured to increase as thesubject, moves closer to the video camera. In a further embodiment, themethod can include identifying different, subsets of image data from aframe of image data in response to changes in the location of thesubject to track movement of the subject image across the frame.

The locations of the subject can be determined using a tracking devicethat generates tracking information and the tracking information can beused to determine the plurality of locations and wherein the subset ofthe image data is identified based on the tracking information obtainedfrom the tracking device. The set of frames of image data can be storedin a manner that allows pixel coordinate location to be ascertained forimage data contained therein, and the subset of image data can beidentified by determining a range of pixel coordinate locations thatcontain image data of the subject in the selected frame based on thelocation information.

In a further embodiment, a video capture system can be provided andconfigured to capture video sequences of a subject during an activity.The video capture system can include a content storage module configuredto a set of frames of image data for a defined coverage area in anactivity location; a content assembly module configured to determinelocation information identifying a plurality of locations of the subjectin the coverage area and a time at which the subject was at eachlocation and configured to select, for each location, one of thesuccessive frames of data corresponding to the time the subject was atthat location and to identify a subset of the image data in the selectedtrams that contains image data of the subject based on the subjectlocation in the coverage area. The content assembly module can beprovided using one or more processors, controllers, ASICs, PLAs or othercomponentry.

The methods, features and functionality of the invention can beimplemented in hardware, software or a combination thereof. For example,a computer program product for creating a video sequence of an activitysubject can be provided. The computer program product can include acomputer useable medium having computer program code recorded thereon,the computer program code can include one or more instructions forcausing a processing device to perform the specified functions.

Other features and aspects of the invention will become apparent fromthe following detailed description, taken in conjunction with theaccompanying drawings, which illustrate, by way of example, the featuresin accordance with embodiments of the invention. The summary is notintended to limit the scope of the invention, which is defined solely bythe claims attached hereto.

BRIEF DESCRIPTION OF THE DRAWINGS

The present invention, in accordance with one or more variousembodiments, is described in detail with reference to the followingfigures. The drawings are provided for purposes of illustration only andmerely depict typical or example embodiments of the invention. Thesedrawings are provided to facilitate the reader's understanding of theinvention and shall not be considered limiting of the breadth, scope, orapplicability of the invention. It should be noted that for clarity andease of illustration these drawings are not necessarily made to scale.

Some of the figures included herein illustrate various embodiments ofthe invention from different viewing angles. Although the accompanyingdescriptive text, may refer to such views as “top,” “bottom” or “side”views, such references are merely descriptive and do not imply orrequire that the invention be implemented or used in a particularspatial orientation unless explicitly stated otherwise.

FIG. 1 is a diagram illustrating a one example of a ski area inaccordance with one example environment for the invention.

FIG. 2 is a diagram illustrating an example configuration of a pluralityof cameras strategically positioned at various locations about a skiarea to capture images of skiers on the trails in accordance with oneembodiment of the invention.

FIG. 3 is a diagram illustrating an example configuration of a datacapture system in accordance with one embodiment of the invention.

FIG. 4 is a diagram illustrating an example architecture that can beused for a tracking device in accordance with one embodiment of theinvention.

FIG. 5 is a diagram illustrating an example of an image sensor dividedinto a plurality of sectors in accordance with one embodiment of theinvention.

FIG. 6 is a diagram illustrating an example of frame data from one of aplurality of sectors selected in accordance with one embodiment of theinvention.

FIG. 7 is a diagram illustrating an example of a plurality of successivewindows defined across image sensor corresponding to the location of thetrack subject in die area of coverage.

FIG. 8 is a diagram illustrating one example of including apicture-in-picture window in accordance with one embodiment of theinvention.

FIG. 9 is a diagram illustrating one example of a data format for imagedata in accordance with one embodiment of the invention.

FIG. 10 is a diagram illustrating another example of a data format forimage data tags in accordance with one embodiment of the invention.

FIG. 11 is a diagram illustrating a high-level flow for gatheringtracking information and capturing content in accordance with oneembodiment of the invention.

FIG. 12 is an operational flow diagram illustrating an example processfor tracking a participant in gathering data in accordance with oneembodiment of the invention.

FIG. 13 is an operational flow diagram illustrating a process forassembling content information using a batch mode in accordance with oneembodiment of the invention.

FIG. 14 is a diagram illustrating an example process for assemblingcontent information in real time in accordance with one embodiment ofthe invention.

FIG. 15 is a diagram illustrating an example computing module inaccordance with one embodiment of the invention.

The figure are not intended to be exhaustive or to limit the inventionto the precise form disclosed. It should be understood that theinvention can be practiced with modification and alteration, and thatthe invention be limited only by the claims and the equivalents thereof.

DETAILED DESCRIPTION OF THE EMBODIMENTS OF THE INVENTION

The present invention is directed toward a system and method forcapturing content of a subject such as for example, during an event orother activity. In one embodiment, the captured content, is a motionpicture of a subject engaging in an activity or in the event. In anexample application, a plurality of cameras are positioned at variouslocations about an event venue or other activity location. An activityparticipant can be provided with a tracking device to enable his or herposition to be tracked or otherwise determined at the event venue. Thetracking information can then be correlated with data gathered from thevarious cameras to assemble a video of the subject as he or she movedabout the event venue. The video can be made available to theparticipant or her friends and family as a memento of the occasion.

Before describing in detail the invention, it is useful to describe afew example environments with which the invention can be implemented.One such example venue is that of a ski area. A typical ski areaincludes multiple trails traversing a mountainside, and can be spreadout over an area of several hundred acres to several thousand acres ormore. These trails can be varied and diverse, and often definephysically separate and distinct skiing areas. As just one example, theCopper Mountain ski resort in Colorado is believed to have approximately125 runs across more than 2400 acres, ranging in elevation from a baseof 9,712 feet (2,960 m) to 12,313 feet (3,753 m). A typical skierenjoying a day on the slopes may ski on any number of different trailsthroughout the day and usually does not follow a predetermined scheduleor pattern. Accordingly, it would typically be difficult to predictwhere the skier might be on the mountain at any given time during theday. The skier's speed and path down, a given slope may also vary,making it even more difficult, if not impossible to predict, the skier'spath.

FIG. 1 is a diagram illustrating a one example of a ski area inaccordance with one embodiment of the invention. Referring now to FIG.1, the example ski area 120 includes a plurality of trails traversingthe side of a hill or mountain. Ski area 120 also includes one or moreski lifts 124 such as, for example, chairlifts, J-bars or T-bars,gondolas and the like. Ski lifts 124 are supported by one or moreupright support members 126 as illustrated in the example of FIG. 1.Upright support members 126 might be, for example, poles or columns usedto support cables that are part of the ski lift mechanism. In theillustrated example, support members 126 are disposed along one or moreski trails.

As illustrated in FIG. 1, the example ski area includes a variety oftrails traversing the mountain. Skiers enjoying skiing at this ski area120 are able to ski on any or all of these trails depending on theirability. Accordingly, to track a skier during a prolonged period ofskiing could require the ability to track the skier across a large area.Although the example illustrated in FIG. 1 shows to ski lifts 124 and aparticular arrangement of a plurality of trails, one of ordinary skillin the art would understand that alternative ski areas could include anyof a variety of combinations of ski lifts trails and other skiingfeatures. Additionally, the environment can span multiple ski areas orother activity areas as well.

One other example environment that will be briefly described is aracetrack, BMX track or other racecourse. These environments have somesimilarities to the ski slope. There is typically a large area overwhich the driver travels during the course of time trials, practice lapsor actual races. The driver's speed around the course and, indeed atvarious sections of the course, may vary from lap to lap and during agiven lap. Accordingly, it would likewise be difficult to predict adriver's future location at given times along the track. For BMX parks,dune areas and other like environments, the driver might not be confinedto a track and trails are not necessarily well defined. This furtheradds to the challenge in capturing video or other content of thesubjects.

As yet another example environment, consider a wildlife preserve orother wildlife habitat in which it is desired to capture videoinformation about one or more species of wildlife. In such anenvironment, the participants would be the wildlife subjects that havethe ability to roam about the habitat. Tracking and videographing thesesubjects could likewise be time-consuming, but could also be dangerousto the videographer and could disrupt the natural patterns of thespecies. Thus, this environment also poses challenges in capturing videoof the subjects.

As still a further example environment, consider a metropolitan areathat has a network of roadways about which vehicles travel. In such anenvironment, subjects could be, for example, vehicles, pedestrians, orother mobile objects moving about the metropolitan area. Thisenvironment likewise poses similar challenges to capturing contentregarding the one or more subjects therein.

Accordingly, these described example environments provide a challenge tocapturing content such as, for example motion video, of one or moreactivity participants. Factors such as the area spanned by theactivities, variability in participant speed and location, to name afew, contribute to the difficulties associated with capturing content ofthe participants.

From time-to-time, the present invention is described herein in terms ofthese example environments. Description in terms of these environmentsis provided to allow the various features and embodiments of theinvention to be portrayed in the context of an exemplary application.After reading this description, it will become apparent to one ofordinary skill in the art how the invention can be implemented indifferent and alternative environments with different subjects.

The present invention is directed toward a system and method forproviding the ability to track a participant of an event or activity,and can capture the routes used during his or her performance of thatactivity. The present invention can also provide the ability to capturecontent of die participant as he or she is being tracked through theperformance of the activity. For example, in one embodiment, the presentinvention provides the ability to capture motion images of an activityparticipant during the performance of the activity. Preferably, in oneembodiment, the images can be captured for the participant in situationswhere the participant might travel over a large area during the courseof performing activity.

For example, consider the example environment of the ski area asdescribed above with reference to FIG. 1, or other like ski area. In oneembodiment, the present invention can be implemented to capture motionvideo (with, or without audio) of one or mare skiers skiing down one ormore trails of the ski area throughout a given time interval. In oneembodiment, the one or more participants to be captured on video areprovided with tracking devices to track their movement as they ski.Preferably, the tracking devices have the ability to track the user to afair degree of accuracy as be or she skis down the plurality of trailsat the ski area. As the participant skis along various trails, he or sheis captured by a plurality of cameras positioned along the trails. Theparticipant's position as captured by the tracking, device is correlatedwith images captured by the camera such that a video of the participantskiing down the trails can be assembled. In one embodiment, timinginformation is used to correlate the tracked position to the correctdata at the designated cameras.

Accordingly, in one embodiment, a plurality of cameras cars be fixed atvarious locations of the ski area (or other environment) to captureimages of the skiers as they ski down the various trails. FIG. 2 is adiagram illustrating an example configuration of a plurality of camerasstrategically positioned at various locations about a ski area tocapture images of skiers on the trails in accordance with one embodimentof the invention. This is a simplified example used merely to illustratethe manner in which a plurality of cameras might be positioned to covera plurality of trails. After reading this description, one of ordinaryskill in the art would understand how alternative configurations ofcameras with similar or different layouts of trails can be accomplishedin accordance with the principles of the invention.

Referring now to FIG. 2, in the illustrated example, a plurality ofcameras 132 are illustrated as being mounted at various locations alongthe illustrated portions of the ski area. Some of the cameras 132 areillustrated as being mounted on ski lift poles 126. Other cameras 132are illustrated as being mounted on structures other than the ski liftpoles 126. Dashed lines are used to illustrate example fields of view ofcameras 132 positioned in FIG. 2. As the example of FIG. 2 illustrates,cameras can be appropriately positioned along various portions of theski area (or other environment) to provide suitable coverage of thearea. As would be appreciated by one of ordinary skill in the art, thefield of view can be selected for each camera 132 based on its mountinglocation and the desired area of coverage for that camera. As FIG. 2illustrates, it may be preferable to mount the cameras 112 such thattheir view is in the direction of the trail rather than across thetrail. Where cameras 132 are mourned viewing across or perpendicular tothe direction of the trail, a skier skiing past the camera would tend totravel too quickly past the field of view, depending of course on thefield of view and other parameters.

In one embodiment, cameras 132 can be mounted in fixed locations and canalso be mounted in a fixed manner such that they do not physically panor tilt or otherwise move from their designated orientation.Accordingly, in such embodiments, it may be desirable to appropriatelyselect a field of view for each camera in accordance with its mountinglocation and the desired area of coverage. As discussed in furtherdetail below, image sensors used with cameras 132 can be sizedsufficiently to provide a greater coverage area. High-resolution imagesensors can be chosen with a sufficient area and resolution tofacilitate electronic pan, tilt aid zoom operations. Image sensorschosen can be, for example, CCD, CMOS, or other image sensors assuitable based on available technology at the time.

In another embodiment, one or more cameras 132 can be mounted so thatthey can be repositioned for operations such as, for example, pan andtilt operations, or other operations, to allow the camera to track andidentify participant during data gathering. In such an embodiment,tracking data from the participants tracking device can be gathered inreal time and used to provide a feedback to a control mechanism tocontrol the pan, tilt and mom operations of one or more cameras 132.

In another embodiment, one or more cameras 132 can be mobile camerasmoving about the ski slope attached to skiers or vehicles, each camerausing its own data logging device to track its location, direction andfield of view. This data can be used to calculate the geographiccoverage ansa of each frame of video shot and all of this data furthercorrelated with the participant's data to compile the video clips.

FIG. 3 is a diagram illustrating an example configuration of a datacapture system in accordance with one embodiment of the invention.Referring now to FIG. 3, a plurality of cameras 132 are illustrated asbeing communicatively coupled to a data processing environment 260. Inthe illustrated embodiment, data processing environment 260 includes adata store 262 and a data processing and assembly module 264. In theillustrated example, data processing environment 260 also includes adata store for assembled sequences 268 and a communications interface266. Although data store 262 and assembled sequences 268 storage areillustrated as separate data storage units, one of ordinary skill in theart would understand that these can be combined as a single storage areaappropriately partitioned. Likewise, one of ordinary skill in the artwould understand that other physical or logical partitioning of the datastorage areas can be implemented.

In one embodiment, one or more cameras 132 can fee configured to streamtheir data in real-time to the data processing environment 269. Inanother embodiment the data can be downloaded in batches at periodic orother intervals rather than streamed in real-time. As described above, aplurality of cameras 132 are positioned at various locations throughoutthe environment. Image data such as, for example, data captured via aCCD CMOS or other image sensor, can be sent to data processingenvironment 260 via a wired or wireless communication link. The datasent to data processing environment 260 can include identificationinformation indicating from which camera 132 the data was received.

The data can also be time stamped either by cameras 132 or dataprocessing environment 260 such that the data can later be correlatedwith tracking information for given time periods. In one embodiment,segments or other subsets of the data can be time stamped such that thesegments can be retrieved based on camera identification and time-stampinformation. Frame-by-frame time stamping could consume relatively largeamounts of storage space. Accordingly, a time-stamped segment couldcomprise a single frame of data but preferably would comprise aplurality of frames captured at or near the marked time. The resolutionof the time stamping can be chosen based on a number of factorsincluding, for example, resolution of the timing system, geographiccoverage area of a frame, anticipated rate of travel of the subjectthrough a frame coverage area, and so on. Of course, if digital pan,tilt or zoom operations are used, a higher timing resolution might bedesirable depending on the goals of the design.

In another embodiment, an indirect time-stamp approach can beimplemented. For example, in one approach one or more epochs can be timestamped such as, for example, the start of a recording event or periodicrecording intervals. In such an embodiment, desired segments (frames orgroups of frames) can be identified based on elapsed time from the notedepoch. For example, based on the frame rate, a desired video segmentcaptured at a given time might be located based on the number of frameselapsed alter the epoch event. Accordingly, each segment is notnecessarily time stamped individually, but an epoch time stamp can beused in conjunction with other temporal computations to locate thedesired image data corresponding with a given location and a given time.

As described in further detail below, image sensors used with one ormore cameras 132 may be relatively large area, high-resolution imagesensors that are partitioned into multiple sectors. Accordingly,partition information can also be provided with the data captured andsent to data processing environment 260 such that captured dataassociated with a particular partition can be identified. This can beused to support digital pan, tilt and zoom operations.

In a similar vein, the data received from cameras 132 can include x-y orother like information identifying the area of the image sensor towhich, the data corresponds. Accordingly, with a high enough resolutionand a large enough area of the image sensor, this x-y data used tosupport another embodiment of electronic or digital pan, tilt and zoom,operations allowing data to be used from only selected areas of theimage sensor for given time intervals.

Data store 262 can be configured to store data from cameras 132 alongwith other information such as, for example, camera identificationinformation, image sector identification information, timestamp or epochinformation, or other information that might be useful for assemblingcontent sequences for various participants. Data can be batched to datastore 262 or sent in real-time from cameras 132. Timestamp informationcan be generated at cameras 132 and combined with the data as it iscreated or alternatively, timestamp information can be generated at dataprocessing environment 260 and combined with the data as it is receivedand stored. Examples of how data can be formatted for storage and datastore 262 are described in further detail below.

Also illustrated in the example architecture of FIG. 3 is a data storefor assembled sequences 268. This data store can be used to storeassembled sequences of video data from a plurality of cameras 132. Forexample. In an operation of assembling a video sequence for a designatedparticipant, data processing and assembly 264 gathers the appropriatevideo sequences based on the tracking and timestamp information andconcatenates the sequences together into a series of assembled sequencesto create the participant's video. These assembled sequences can bestored (such as, for example, in the data store for assembled sequences268) such that they can be available to provide to the participant orother requester. In another embodiment, rather than concatenating thesequences into a complete video sequence, the data items are labeled andstored to facilitate a more custom assembly by a user.

Data processing and assembly module 264 ears be included as shown in theexample illustrated in FIG. 3. Data processing and assembly module 264can be used to assemble video sequences from a plurality of cameras 132to create an assembled sequence for user. For example, consider a simplescenario where a skier wishes to purchase a video of himself skiing downthe slopes. In such a scenario, the user is given a tracking device tocarry with him while be is skiing. Data processing and assembly module264 receives the tracking data horn the tracking device. For example,this could be accomplished by interface 266 in real time or at the endof the skiing session. Data processing and assembly module 264 evaluatesthe tracking data to determine where the skier was during various timesof the skiing session. Data processing and assembly module 264correlates the time-stamped tracking information with various videosequences received from the cameras 132 positioned about the ski area.Data processing and assembly module 264 retrieves the video sequencescorresponding to the appropriate cameras for the appropriate times togather sequences of video that, contain shots of the designatedparticipant. In embodiments where digital pan, tilt or zoom features areincluded, data processing and assembly module 264 can use the trackinginformation to further identity the appropriate sector of a givencameras' image sensor (or other pixel range) corresponding to thetracking information.

Interface 266 can be used to provide a communications interface toreceive tracking data from one or more participants being tracked.Interface 366 can also provide a communication interlace to download orotherwise provide assembled content (i.e., motion video in the exampleenvironment) to the participant or other user of the system.Accordingly, interlace 266 can include the appropriate wired or wirelesscommunication interfaces to accommodate the desired features andfunctionality. For example, a wired or wireless interface can beprovided to receive tracking data from the various tracking devices usedby the participants. In one embodiment, such tracking data can bereceived by the system in real-time as the skiers are skiing along theslopes. Accordingly, in such, an embodiment, such an interface wouldpreferably be a wireless interlace capable of receiving real-timetracking data for each user.

In another embodiment, tracking data can be received in a hatch modeafter tracking data has been gathered for a participant. For example,alter a morning of skiing (or a day of skiing, or other time.), theparticipant can cause his or her tracking data to be downloaded to dataprocessing system 260. Accordingly, a wired or wireless interlace can beprovided to allow die tracking device to download the data in a batchmode. Preferably, data downloaded in the batch mode includes timestampinformation to allow the participant's tracking information to becorrelated with time. In other words, the epoch data can be used toidentify, along with the tracking data, where the participant was at agiven time of day.

This information can be used to select the appropriate cameracorresponding to the coverage area in which the participant was skiingat a given time. Furthermore, the data received for each participantwould include an identification that can be used to identify thetracking information with the particular participant. Such informationcan be later used when assembling motion video sequences for theparticipants.

FIG. 4 is a diagram illustrating an example architecture that can beused for a tracking device in accordance with one embodiment of theinvention. Referring now to FIG. 4, the example architecture illustratedincludes a position determination module 282, a timestamp module 284, adata storage module 288, a wired or wireless interface 290, and a powersource 286. Because the tracking device is carried by the participantperforming the activity, it is preferred that the tracking device besmall and light weight. It is also preferred, for the same reason, thatthe power source 286 be configured to be able to power the trackingdevice for the duration of the intended session. Accordingly, in oneembodiment, the power source 286 is a rechargeable battery source suchas, for example, a lithium, ion battery. However, any of a number ofalternative power sources can be provided.

Position determination module 282 can be implemented using any of avariety of position determination technologies. For example, in oneembodiment, GPS technology can be used to perform the positiondetermination for the tracking device. Although not illustrated, a GPSantenna can be provided to receive the appropriate satellite signalsfrom the GPS constellation. A GPS receiver and processing module can beused to decode the satellite timing signals and compute the trackingdevice position based on those signals.

As another example, various forms of RF or other wireless triangulationtechniques can be used to perform the position determination. Forexample, a plurality of transmitters can be positioned at variouslocations about the activity area. Position determination module 282could include a receiver to receive wireless signals from the varioustransmitters as well as a processing module to process the receivedsignals from the transmitters at known locations to thereby triangulatethe position of the tracking device.

As still another example, RFID transponders can be positioned at variouslocations about the activity area. The tracking device can include anRFID communication unit that can communicate a signal to a transponderwhen in proximity to that transponder, thereby indicating the positionof the tracking device. The RFID communication unit can includeidentification of the tracking device such that a plurality of trackingdevices can be used with the RFID transponders.

In embodiments where GPS or other like technology is utilized, locationinformation is generated at the tracking device and therefore preferablystored locally at the tracking device such as, for example, in a datalog 288. In this manner, the tracking data can be saved as it isgenerated and downloaded either in real time or in hatch mode such as,for example, via interface 290.

The example depleted in FIG. 4 is illustrated as including a timestampmodule 284 to gather timing information during tracking activities. Forexample, a real-time clock synchronized with the rest of the system, canbe used to keep track of time as location is being tracked. Accordingly,position data stored in data log 288 or transmitted in real-time to thecentral server can be tagged with the appropriate timestamp information.As a result of this feature, the system can be used to determine wherethe participant was at a given time during the tracking activities. Thiscan be later used when correlating tracking information with camerainformation to select not only the correct camera or camera sector(based on tracking information) but also to determine which, data for agiven time period from that camera or sector should be utilized.

Although not separately illustrated, a controller can be included tocontrol the operations of the tracking device and to assemble theposition and time information appropriately as well as to store thisassembled information in data log 288. A dedicated controller can beprovided to perform the specified functions or a shared controller canfee utilized to control the operations of position determination andtime stamping as well. As discussed above with respect to image data,tracking data timing information can be derived directly or indirectly.For example, in one embodiment, segments of tracking data can beindividually time stamped to provide a direct indication of the time atwhich a participant was positioned at a given location. Alternatively,in another embodiment, epochs can fee time stamped such as, for example,the beginning of the activity. From this known time location informationcorresponding to a given point in time can be located. Accordingly, aswith the video data each item of tracking data, is not necessarily timestamped individually, but an epoch time stamp can be used in conjunctionwith other temporal computations to locate the desired tracking data,corresponding to a given time.

As discussed, interlace 290 can be a wired or wireless interface and canbe primarily configured to transfer tracking data from the trackingdevice to the server. In one embodiment, a longer-range wirelessinterface can be provided to allow real-time tracking data to bedownloaded to the system as the participant travels across the activityarea. Depending on the size of the area covered in the duration of theactivity, a real-time wireless interlace may be undesirable due to powerand range considerations. Accordingly, in another embodiment, thetracking device is configured to store the tracking information anddownload it in a batch mode to the server at the end of the activity orat periodic intervals. For example, at the end of the activity sessionthe participant can return the tracking device and communication can beinitiated between the tracking device and the data processingenvironment 260. In other words, interface 290 can communicate withinterlace 266 to transfer the tracking and timestamp information forprocessing by data processing and assembly module 264. In environmentswhere the data is stored with the tracking device and later downloadedin a batch mode, it is preferred that timestamp information be storedwith the data such that it can be appropriately correlated as describedabove. In embodiments where data is transmitted in real time to the dataprocessing environment, it may be preferable to have the data processingenvironment perform the time measurement and timestamp operations tothereby reduce the load on the tracking device and thus its powerconsumption.

As described above, in one embodiment, operations such as pan, tilt andzoom may be performed electronically or digitally without having tochange camera position. Accordingly, one or more of the various cameras132 can be in a fixed location with a fixed orientation and fixed focusand zoom parameters. As also described above, the geographic coveragearea of the various cameras 132 can be known data element and can befixed in advance. Therefore, die tracking information can be used totrack the participant's movement through the coverage area of a givencamera. In one embodiment the tracking data can then be used to not onlyidentify which camera 132 of a plurality of cameras 132 contains imagedata of the participants, but also which portion of the camera's imagesensor contains data of the participant.

FIG. 5 is a diagram illustrating an example of an image sensor dividedinto a plurality of sectors in accordance with one embodiment of theinvention. Referring now to FIG. 5, in the illustrated example a sensor320 is shown as being divided into nine segments 322. In the illustratedexample, the segments comprise subsets of pixels, and the resultantpixel data that axe defined subsets of the entire frame. In oneembodiment, the subsets or segments 322 can be defined bytwo-dimensional pixel-coordinate ranges or other definitionalparameters.

Also in the illustrated example, segments 322 are approximately equal indimension to one another. Accordingly, in this example, each segment 322contains approximately the same number of pixels configured inapproximately the same aspect ratio. In alternative embodiments,segments 322 can be of various dimensions depending on the applicationand the features of the coverage area. Preferably, the aspect ratio ofeach sector 322 conforms to the aspect ratio of the final assembledsequence. In one embodiment, the aspect ratio of each sector 322 is thesame as the aspect ratio of full image sensor 320. Accordingly, in oneembodiment, the sensor 320 is divided into an equal number of rows andcolumns.

Also illustrated in FIG. 5 is a path 324 of the subject to be recorded.For example, in accordance with the example environment, path 324 canrepresent the path taken by the skier cross the geographic coverage areacovered by image sensor 320. In the illustrated example, the skier inthis pass across the area covered by image sensor 320 actually traversedareas covered by five of the nine sectors 322. In embodiments where animage sensor is divided (electronically or otherwise) into a pluralityof sectors 322, the data assembled into the final sequence can be usedas full frame data or as data from a set of one or more sectors 322. Inone embodiment, the system can be configured to automatically assemblethe video sequences on a sector-by-sector basis. That is, in thisembodiment, when the tracking information is used to select video datafor assembly, where only one sector 322 in which the participant iscovered is selected. Thus, the plurality of successive sectors 322 canbe strong together to create the assembled video sequence.

Transitions between sectors can be accomplished similar to transitionsbetween cameras. For example, the assembled video can simply switch fromsector to sector to sector much in the way that a normal videoproduction switches from camera to camera. Fades, wipes or othertransition effects can be added to enhance the finished product.

FIG. 6 is a diagram illustrating an example of frame data from one of aplurality of sectors 322 selected in accordance with one embodiment ofthe invention. Referring now to FIG. 6, the illustrated sector 322 iscenter sector 322 in FIG. 5. FIG. 6 illustrates, accordingly, the videosequence that would be provided when this sector is selected forassembly into the final assembly sequence.

In another embodiment, rather than dividing image sensor 320 into agroup of sectors, the subject can be “followed” across the image sensor.For example, in one embodiment a subset of pixels can be selected as anarea of pixels around the position of die subject as he, she or ittraverses the area covered by the image sensor. Additionally, as thesubject moves, the area of pixels moves with the subject. For example, awindow 332 of pixels can be defined in the frame selected such that thesubject is approximately centered in the window 332. In one embodiment,window 332 can be chosen as having a predefined aspect ratio. Forclarity of illustration, only one of windows 332 includes the referencenumber on the FIG. As the subject moves across the geography covered byimage sensor 320 the window 332 moves as well thereby keeping thesubject in the frame of selected data. Accordingly, in one embodiment,x-y or other locational pixel information ears be used when retrievingvideo information corresponding to the tracking data.

FIG. 7 is a diagram illustrating an example of a pi aridity ofsuccessive windows 332 defined across image sensor 320 corresponding tothe location of the subject in the area of coverage. The windows 332preferably conform to the final aspect ratio of the assembled sequenceso that they do not introduce an undue amount of distortion. In oneembodiment the subsets 332 can be defined by two-dimensionalpixel-coordinate ranges or other definitional parameters. Additionally,windows of other shapes can be provided. In another embodiment, windowsizing can be configured to change depending on a plurality of factorssuch as, for example, number of subjects in the frame, proximity of thesubjects to one another, proximity of the subject to the camera and soon. For example, as the subject moves closer to the camera, with a fixedoptical focal length, the subject would tend to occupy more of theframe. Accordingly, the subset 322 would be selected to cover a largerimage sensor area as the subject moves closer. Knowledge regarding thesize of the subject focal length of the system, position of the subjectand the like can be used to facilitate the calculation.

The above described and other like embodiments can be implemented so asto have the effect of providing an electronic or digital pan, tilt orzoom, features for capturing content relating to the subjects. Forexample, selecting a subset of pixels and using those to display thefull frame image can have the effect of zooming in on the selected area.Similarly, following the subject by moving or changing the selectedsubset as the subject moves can have the same effect as pan and tiltoperations with a camera having a smaller field of view. As one ofordinary skill in the art would, appreciate alter reading thisdescription, if the higher the resolution of the image sensor, thehigher the resolution will be of a given subset of pixel data.Accordingly, a higher resolution image sensor would tend to allowselection of a smaller area of the image sensor as a subset whilemaintaining a given level of quality, with other factors being equal.

In one embodiment the selected window size can be changed to furthereffectively zoom in on or zoom out from the subject. For example, asdata is retrieved from the data store, the number of pixels or pixelarea can be defined to provide the desired zoom level. Bi-linearinterpolation or other like techniques can be utilized to furtherenhance this feature. Pixel pitch and image sensor resolution areparameters to consider when determining a maximum zoom capability.

In another embodiment, enhanced features such as picture-in-picturevideo sequences can be created. To illustrate by way of example,consider the sector-divided image sensor 320 illustrated with respect toFIG. 5. In this example, consider a scenario wherein the full frameimage sensor (or other set of sectors 322) is provided as the backgroundand a single sector 322 is provided as a pop-up window overlaying thebackground window to provide a zoomed-in insert. FIG. 8 is a diagramillustrating one example of including a picture-in-picture window inaccordance with one embodiment of the invention. Referring now to FIG.8, illustrated as the background window is image sensor 320 with thetrack 324 illustrating the path of the subject moving through thevisible area of the image sensor. Also illustrated in FIG. 8 is theoverlay window 340 used to provide the picture-in-picture feature. Inthe illustrated example, overlay window provides the video sequence forone area of image sensor 320. Particularly, in this example, theselected area is highlighted by rectangle 342. A zoomed-in image of area342 is shown as an overlay 340 while the participant is skiing in thatarea. In one embodiment, the invention can be configured such that thesector displayed in pop-up window 340 changes from sector to sector asthe participant transitions from sector to sector, or moves somewhatmore continuously as the participant moves from area to area across thesensor.

In one embodiment, a user can be given control in the assembly processsuch that factors such as zoom level sector selection, sectortransition, camera transitions, background music clips,picture-in-picture features and other aspects for the assembled sequencecan be chosen and manipulated. Accordingly, in one embodiment, the usercan be provided with flexibility in assembling the assembled videosequence.

FIG. 9 is a diagram illustrating one example of a data format for imagedata in accordance with one embodiment of the invention. In the exampleillustrated in FIG. 9, the data that is stored is stored with tags forits associated camera ID 422, a sector ID 424 and a timestamp 426. Thus,in this illustrated example, the data that is clocked out for eachsector is tagged with this information.

FIG. 10 is a diagram illustrating another example of a data format forimage data tags in accordance with one embodiment of die invention.Referring now to FIG. 10, in this example the data that is stored isstored with tags for camera ID 422 and a time-stamp 426 as illustratedabove in die example of FIG. 9. However, in this example, instead of asector ID 424 there is a pixel ID 428. Pixel ID 428 can, for example, beused to define a range of pixels for which the data is stored.Accordingly, predefined areas of the image sensor can be stored andtheir pixel range is tagged to identify that data. Alternatively, thedata can be stored on a pixel-by-pixel basis such that the data can beresolved to a desired, level. As one of ordinary skill in the art willappreciate, where data is stored on a pixel-by-pixel basis, it is notnecessary to store a pixel ID for each pixel. Instead, beginning or endflags can be used to store a set of pixel data and counter or addressingschemes can be used to locate a desired pixel or range of pixels.

FIG. 11 is a diagram, illustrating a high-level flow for gatheringtracking information and content in accordance with one embodiment ofthe invention. Referring bow to FIG. 11, in a step 522 a camera layoutis determined to accomplish the desired coverage and cameras can then beappropriately positioned. For example, in terms of the ski slopeenvironment, a plurality of cameras 132 are positioned at appropriatelocations throughout the ski area to be able to capture motion picturedata over desired areas of the ski slope.

In a step 524 the geographic area of coverage is determined and definedfor each camera 132 that is installed. This information can then laterbe used to correlate tracking information with camera information toidentify the cameras captured and identified participant or participantsskiing in a given coverage area. The coverage area can be identified,for example, by latitude and longitude boundaries such that this datacan be correlated with GPS or other like tracking data. As anotherexample, in embodiments where RFID or other like communication devicesare used to track participant, location, the geographic coverage areascan be defined by transponder locations.

As noted above, in some embodiments camera image sensors can be dividedinto sectors each having a given coverage area. Accordingly, in oneembodiment, at 526 the geographic areas of coverage for the sectors ofeach of the cameras can also be identified and stored. Techniques usedto identify and store sector area coverage information can be similar tothose described above with respect to identification and storage ofgeographic coverage information for cameras. In an alternativeembodiment in step 528, sectors can be mapped, with geographic areas.For example, pixels or pixel ranges can be correlated with thegeographic area to which they correspond. This can later be used tofacilitate digital pan, tilt and mom operations. With the cameras andimage sensor subsets identified a mapped, the system is ready to gatherand store video information from the plurality of cameras as illustratedby step 530.

FIG. 12 is an operational flow diagram illustrating an example processfor tracking a participant and gathering data in accordance with oneembodiment of the invention. Referring now to FIG. 12, in a step 562 atracking device is assigned to a participant. For example, a trackingdevice such as those described in various embodiments herein can beprovided to the participant to wear on his or her clothing or otherwisecarry it along throughout the activity. Preferably, the tracking deviceshave a serial number or other means of identification such, that aparticular tracking device can be associated with a particularparticipant.

In a step 564, the data gathering process is initiated with the trackingdevice. As described above, and various embodiments as the participanttravels about the environment area the tracking device gathers trackingdata as well as timing information to enable determination of where theuser was in the area at a given tone. As also described, in anotherembodiment, a tracking device communicates with transponders locatedthroughout the area such that participant location can be tracked duringactivity participation. The operation of tracking participant locationusing the tracking device is illustrated by a step 566.

In a step 568, the tracking data is read and used to gather videoinformation corresponding to the times and locations identified by thetracking data. In a step 570, the gathered video information isassembled into a completed video of the participant.

As stated above, tracking information can be sent to the server in realtime or by one or more batches in a batch mode. FIG. 13 is anoperational flow diagram illustrating a process for assembling contentinformation using a batch mode in accordance with one embodiment of theinvention. Referring now to FIG. 13, in a step 622 a batch of locationdata is downloaded to the data assembly server. In this embodiment, thedownloaded data includes tracking or location information for theparticipant as well as timestamp information for the reported locations.As already stated, this enables the determination of where a participantwas at which times during the activity. The location information isretrieved preferably on a serial basis.

In a step 624, as the location information is retrieved it is correlatedwith geographic data on the cameras to determine which camera has datacorresponding to the participant's location. In a step 626, the timestamp information for a given set of location data is read. The cameraand time stamp information can then be used to retrieve datacorresponding to the proper participant location at that time. This isillustrated by a step 628. At a step 630, the retrieved video data isappended to the previous data to assemble a video sequence asillustrated by step 630. This process can continue for any or all of thetracking data in the tracking device.

FIG. 14 is a diagram illustrating an example process for assemblingcontent information in real time in accordance with one embodiment ofthe invention. Referring now to FIG. 14, in a step 672, tracking data isreceived from the tracking unit for a given participant. For example,tracking data can be GPS for other position information sent wirelesslyto the server in real time, as the participant is engaging in anactivity. As another example, the tracking data can be generated basedon tracking device communications with various transponders positionedabout the activity area.

In a step 674, the location information is determined and this locationinformation is used to identify camera corresponding to that geographicarea. At step 676, the data from that camera is captured. Of course, inembodiments where sectors or digital zoom are used, sector or pixelrange information can also be used to identify appropriate camera datafor inclusion in the video sequence. In a step 678, the video clips areassembled into complete video assembly.

The final video can be created and delivered to the participant or otheruser according to a number of different mechanisms. In one embodiment,content selection and assembly occurs automatically upon receipt oftracking data. That is. In one embodiment, the tracking data is used toretrieve corresponding video information and video information assembledinto the final motion video. In alternative embodiments however, theability for user to produce a more custom content package can beprovided. For example. In one embodiment, the user can be provided withan editing application that allows the user to select whether to keep ordiscard various sections of video footage. An editing application canalso be configured to allow a user to manually control pan, tilt andzoom operations as well as transitions from camera to camera or sectorto sector. As a former example, in this embodiment, the user might beprovided with all of the raw data from the various cameras at which itwas captured. The user can then manipulate the data and control framing,zooming, and other aspects of the data by selecting subsets of theentire data package for inclusion in the final assembly sequence. Thus,a user can personalize the content in accordance with his or herpreferences.

In one embodiment, the assembled video or the raw data can be providedto the participant at the activity location. In another embodiment, theuser can log into the system (for example via the internet or othercommunication medium) to access the data and assemble a video or play apreviously assembled video. Accordingly, with a web-based or otherremote access means, users can be given, the opportunity to create orcustomize their content after they have completed the activity.

As used herein, the term module might describe a given unit offunctionality that can be performed in accordance with one or moreembodiments of the present invention. As used herein, a module might beimplemented utilizing any form of hardware, software, or a combinationthereof. For example, one or more processors, controllers, ASICs, PLAs,logical components or other mechanisms might be implemented to make up amodule. In implementation, the various modules described herein might beimplemented as discrete modules or the functions and features describedcan be shared in part or in total among one or more modules. In otherwords, as would be apparent to one of ordinary skill in the art afterreading this description, the various features and functionalitydescribed herein may be implemented in any given application and can beimplemented in one or more separate or shared modules in variouscombinations and permutations. Even though various features or elementsof functionality may be individually described or claimed as separatemodules, one of ordinary skill in the art will understand that thesefeatures and functionality can be shared among one or more commonsoftware and hardware elements, and such description shall not requireor imply that separate hardware or software components are used toimplement such features or functionality.

Where components or modules of the invention are implemented in whole orin part using software, in one embodiment, these software elements canbe implemented to operate with a computing or processing module capableof carrying out the functionality described with respect thereto. Onesuch example computing module is shown in FIG. 15. Various embodimentsare described in terms of this example computing module 700. Afterreading this description, it will become apparent to a person skilled inthe relevant art how to implement, the invention using other computingmodules or architectures.

Referring now to FIG. 15, computing module 700 may represent, forexample, computing or processing capabilities found within desktop,laptop and notebook computers; hand-held computing devices (PDAs, smartphones, cell phones, palmtops, etc.); mainframes, supercomputers,workstations or servers; or any other type of special or general purposecomputing devices as may be desirable or appropriate for a givenapplication or environment. Computing module 700 might also representcomputing capabilities embedded within or otherwise available to a givendevice. For example, a computing module might be found in otherelectronic devices such as, for example, digital cameras, navigationsystems, cellular telephones, modems, routers, WAPs, and any otherelectronic device that might include some form or processingcapabilities.

Computing module 700 might include one or more processors or processingdevices, such as a processor 704. Processor 704 might be implementedusing a general-purpose or special-purpose processing engine such as,for example, a microprocessor, controller, or other control logic. Inthe example illustrated in FIG. 15, processor 704 is connected to a bus702 or other communication medium to facilitate interaction with othercomponents of computing module 700.

Computing module 700 might also include one or more memory modules,referred to as main memory 708. For example, preferably random accessmemory (RAM) or other dynamic memory, might be used for storinginformation and instructions to be executed by processor 704. Mainmemory 70S might also be used for storing temporary variables or otherintermediate information during execution of instructions to be executedby processor 704. Computing module 700 might likewise include a readonly memory (“ROM”) or other static storage device coupled to bus 702for storing static information and instructions for processor 704.

The computing module 700 might also include one or more various forms ofinformation storage mechanism 710, which might include, for example, amedia drive 712 and a storage unit interface 720. The media drive 712might include a drive or other mechanism to support fixed or removablestorage media 714. For example, a hard disk drive, a floppy disk drive,a magnetic tape drive, an optical disk drive, a CD or DVD drive (R orRW), or other removable or fixed media drive. Accordingly, storage media714, might include, for example, a hard disk, a floppy disk, magnetictape, optical disk, a CD or DVD, or other fixed or removable medium thatis read by, written to or accessed by media drive 712. As these examplesillustrate, the storage media 714 can include a computer usable storagemedium having stored therein particular computer software or data.

In alternative embodiments. Information storage mechanism 710 mightinclude other similar instrumentalities for allowing computer programsor other instructions or data to be loaded into computing module 700.Such instrumentalities might include, for example, a fixed or removablestorage unit 722 and an interface 720. Examples of such storage units722 and interfaces 720 can include a program cartridge and cartridgeinterface, a removable memory (for example, a flash memory or otherremovable memory module) and memory slot, a PCMCIA slot and card, andother fixed or removable storage units 722 and interfaces 720 that allowsoftware and date to be transferred from the storage unit 722 tocomputing module 700.

Computing module 700 might also include a communications interlace 724.Communications interface 724 might be used to allow software and data tobe transferred between computing module 700 and external devices.Examples of communications interface 724 might include a modem orsoftmodem, a network interface (such as an Ethernet network interfacecard, WiMedia, 802.XX or other interface), a communications port (suchas for example, a USB port, IR port, RS232 port, Bluetooth interlace, orother port), or other communications interface. Software and datatransferred via communications interface 724 might typically be carriedon signals, which can be electronic, electromagnetic, optical or othersignals capable of being exchanged by a given communications interlace724. These signals might be provided to communications interlace 724 viaa channel 728. This channel 728 might carry signals and might beimplemented using a wired or wireless medium. Some examples of a channelmight include a phone line, a cellular phone link, an RF link, anoptical link, a network interface, a local or wide area network, andother wired or wireless communications channels.

In this document, die terms “computer program medium” and “computerusable medium” are used to generally refer to media such as, forexample, memory 708, storage unit 722, media 714, and signals on channel728. These and other various forms of computer program media or computerusable media may be involved in carrying one or more sequences of one ormore instructions to a processing device for execution. Suchinstructions embodied on the medium, are generally referred to as“computer program code” or a “computer program pro-duct” (which may begrouped in the form of computer programs or other groupings). Whenexecuted, such instructions might enable the computing module 700 toperform features or functions of the present invention as discussedherein.

While various embodiments of the present invention have been describedabove, it should be understood that they have been presented by way ofexample only, and not of limitation. Likewise, the various diagrams maydepict an example architectural or other configuration for theinvention, which is done to aid in understanding the features andfunctionality that can be included in the invention. The invention isnot restricted to the illustrated example architectures orconfigurations, but the desired features can be implemented using avariety of alternative architectures and configurations. Indeed, it willbe apparent to one of skill in the art how alternative functional,logical or physical partitioning and configurations can be implementedto implement the desired features of the present invention. Also, amultitude of different constituent module names other than thosedepicted herein can be applied to the various partitions. Additionally,with regard, to flow diagrams, operational descriptions and methodclaims, the order in which the steps are presented herein shall notmandate that various embodiments be implemented to perform the recitedfunctionality in the same order unless the context dictates otherwise.

Although the invention is described above in terms of various exemplaryembodiments and implementations. It should be understood that thevarious features, aspects and functionality described in one or more ofthe individual embodiments are not limited in their applicability to theparticular embodiment with, which they are described, hot instead can beapplied, alone or in various combinations, to one or more of the otherembodiments of the invention, whether or not such embodiments aredescribed and whether or not such features are presented as being a partof a described embodiment. Thus the breadth and scope of the presentinvention should not be limited by any of the above-described exemplaryembodiments.

Terms and phrases used in this document, and variations thereof, unlessotherwise expressly stated, should be construed as open ended as opposedto limiting. As examples of the foregoing: the term “including” shouldbe read as meaning “including, without limitation” or the like; the term“example” is used to provide exemplary instances of the item indiscussion, not an exhaustive or limiting list thereof; the terms “a” or“an” should be read as meaning “at least one,” “one or more” or thelike; and adjectives such as “conventional,” “traditional,” “normal,”“standard,” “known,” and terms of similar meaning should not beconstrued as limiting the item described to a given time period or to anitem available as of a given time, but instead should be read toencompass conventional, traditional, normal, or standard technologiesthat may be available or known now or at any time in the future.Likewise, where this document refers to technologies that would beapparent or known to one of ordinary skill in the art, such technologiesencompass those apparent or known to the skilled, artisan now or at anytime in the future.

A group of items linked with the conjunction “and” should, not be readas requiring that each and every one of those items be present in thegrouping, but rather should be read as “and/or” unless expressly statedotherwise. Similarly, a group of items linked with the conjunction “or”should not be read as requiring mutual exclusivity among that group, butrather should also be read as “and/or” unless expressly statedotherwise. Furthermore, although items, elements or components of theinvention may be described or claimed in the singular, the plural iscontemplated to be within the scope thereof unless limitation to thesingular is explicitly stated.

The presence of broadening words and phrases such as “one or more,” “atleast,” “but not limited to” or other like phrases in some instancesshall not be read to mean that the narrower case is intended or requiredin instances where such broadening phrases may be absent. The use of theterm “module” does not imply that the components or functionalitydescribed or claimed as part of the module are all configured in acommon package. Indeed, any or all of the various components of amodule, whether control logic or other components, can be combined in asingle package or separately maintained and can further be distributedacross multiple locations.

Additionally, the various embodiments set forth herein are described interms of exemplary block diagrams, flow charts and other illustrations.As will become apparent to one of ordinary skill in the art afterreading this document, the illustrated embodiments and their variousalternatives can be implemented without confinement to the illustratedexamples. For example, block diagrams and their accompanying descriptionshould not be construed as mandating a particular architecture orconfiguration.

The invention claimed is:
 1. A video capture system configured tocapture video sequences of a subject during an activity, the videocapture system comprising: a processor, a memory and a plurality ofstorage devices; the video capture system when executed performs thesteps of: receiving a set of successive frames of video images of adefined coverage area in an activity location in a first communicationmodule; receiving tracking information indicating a position of thesubject in the activity location in a second communication module;determining a location of the subject in the defined coverage area basedon the tracking information; and for a plurality of frames in which thesubject is captured, determining, based on the determined location, asubset of the image in each of the plurality of frames that containsimage data of the subject and selecting the determined subset of imagedata in each received frame and assemble the selected subsets into avideo sequence of the subject in a content selection module coupled tothe first and second communication module.
 2. The video capture systemof claim 1, wherein the first communication module is configured toreceive image data from a plurality of content capture devices, eachcapture device having a defined coverage area in the activity location,and wherein the content selection module is further configured to usethe tracking information to identify which of the plurality of capturedevices include image data of the subject.
 3. The video capture systemof claim 1, wherein determining a subset of the image in each of theplurality of frames of video image data that contains image data of thesubject comprises determining for each of the plurality of frames whichgroup of pixels in the frame contains image data of the subject based onthe determined location.
 4. The video capture system of claim 3, whereinthe group of pixels comprises an area of pixels surrounding pixels ofthe subject.
 5. The video capture system of claim 4, wherein assemblingthe selected subsets comprises selecting image data from each group ofpixels and assembling the selected data in a time ordered sequence. 6.The video capture system of claim 4, wherein the area of pixels isselected such that the subject image data is centered in the group ofpixels.
 7. The video capture system of claim 4, wherein the area ofpixels is chosen as an area having a predetermined aspect ratio.
 8. Thevideo capture system of claim 1, wherein each of the plurality of framesis divided into a plurality of sectors, and determining a subset of theimage comprises determining, for each of the plurality of frames, whichsector of the plurality sectors contains image data of the subject. 9.The video capture system of claim 8, wherein selecting and assemblingthe subsets comprises: selecting image data from a first sector for aplurality of frames in which image data of the subject is determined tobe in the first sector; selecting image data from a second sector for aplurality of frames in which image data of the subject is determined tobe in the second sector; and assembling the frames from the first andsecond sector in a time-ordered sequence.
 10. The video capture systemof claim 1, wherein assembling the selected subsets into a videosequence of the subject comprises assembling the selected subsets into afull-frame video sequence of the subject.
 11. The video capture systemof claim 1, wherein the subset of image data for the plurality of framesdefines a moving window across the coverage area.
 12. The video capturesystem of claim 1, wherein different subsets of image data aredetermined by the content selection module to track the subject'smovement across the frame.
 13. The video capture system of claim 1,further comprising a video canters coupled to the first communicationmodule and configured to capture the set of successive frames of videoimage data from the defined coverage area for that camera.
 14. The videocapture system of claim 1, wherein a size of the subset can be selectedto effectively zoom in on the subject by a determined amount.
 15. Thevideo capture system of claim 1, further comprising a tracking deviceconfigured to provide the tracking information.
 16. The video capturesystem of claim 15, wherein the tracking device comprises: a positiondetermination module configured to determine a position of the trackingdevice; a timing module configured to provide timing informationrelating to the determined positions; and a communications interfaceconfigured to communicate time-stamped position information to thecontent assembly device.
 17. A method of capturing video content of anactivity subject, comprising: obtaining a set of successive frames ofvideo image data of a defined coverage area in an activity location;obtaining tracking information indicating a position of the subject inthe activity location; determining a location of the subject in thedefined coverage area based on the tracking information; far a pluralityof frames in which the subject is captured, determining, based on thedetermined location, a subset of the image in each of the plurality offrames that contains image data of the subject; and selecting thedetermined subset of image data in each received frame and assemblingthe selected subsets into a video sequence of the subject.
 18. Themethod of claim 17, further comprising obtaining a second set ofsuccessive frames of video image data of a second defined coverage areain the activity location and using the tracking information to identifywhich of the plurality of sets of successive frames include image dataof the subject.
 19. The method of claim 17, wherein determining a subsetof the image in each of the plurality of frames of video image data thatcontains image data of the subject comprises determining for each of theplurality of frames which group of pixels in the frame contains imagedata of die subject based on the determined location.
 20. The method ofclaim 19, wherein the group of pixels comprises an area of pixelssurrounding pixels of the subject.
 21. The method of claim 20, whereinassembling the selected subsets comprises selecting image data from eachgroup of pixels and assembling the selected data in a time orderedsequence.
 22. The method of claim 20, wherein the area of pixels isselected such that the subject image data is centered in the group ofpixels.
 23. The method of claim 20, wherein the area of pixels is chosenas an area having a predetermined aspect ratio.
 24. The method of claim17, wherein each of the plurality of frames is divided into a pluralityof sectors, and determining a subset of the image comprises determining,for each of the plurality of frames, which sector of the pluralitysectors contains image data of the subject.
 25. The method of claim 24,wherein selecting and assembling the subsets comprises: selecting imagedata from a first sector for a plurality of frames in which image dataof the subject is determined to be in the first sector; selecting imagedata from a second sector for a plurality of frames in which image dataof the subject is determined to be in the second sector; and assemblingthe frames from the first and second sector in a time-ordered sequence.26. The method of claim 18 further comprising storing the image dataobtained and wherein assembling comprises retrieving the identifiedimage data segments from storage for assembly into the video sequence.27. The method of claim 17, wherein the subset of image data for theplurality of frames defines a moving window across the coverage area.28. The method of claim 17, further comprising identifying differentsubsets of image data from a frame of image data in response to changesin the location of the subject to track movement of the subject's imageacross the frame.
 29. The method of claim 17, wherein assembling theselected subsets into a video sequence of the subject comprisesassembling the selected subsets into a full-frame video sequence of thesubject.
 30. The method of claim 17, wherein the subset of image data isselected as a defined sector of the frame.
 31. The method of claim 17,wherein the subset of image data is a range of pixels of a predeterminedsize.
 32. The method of claim 17, wherein the size of the range ofpixels increases as the subject moves closer to the video camera. 33.The method of claim 17, wherein the video image data is received from aplurality of content capture devices, each capture device having adefined coverage area in the activity location, and further comprisingcorrelating the tracking information with defined coverage areas toidentify which of the plurality of capture devices include image data ofthe subject.
 34. The method of claim 33, wherein correlating comprises:determining a location of the subject based on the tracking information;and comparing the determined location with the coverage areas of theplurality of image capture devices to determine which image capturedevice captured image data of the subject at the determined location.35. The method of claim 34, wherein the determining a location andcomparing the determined location with the coverage areas are repeatedfor a plurality of subject locations.
 36. The method of claim 33,further comprising: storing the image data wherein the image data isstored as image data sets each having an associated coverage area andhaving ascertainable timing information; and receiving timinginformation associated with the tracking data; wherein the correlationcomprises determining a location of the subject based on the trackinginformation; using timing information associated with the trackinginformation to determine a time at which the subject was at thedetermined location; comparing the determined location with the coverageareas of the plurality of image capture devices to determine which imagecapture device captured image data of the subject at the determinedlocation; and using the determined time to identify the image segment orsegments from the determined image capture device that correspond to theidentified time.
 37. The method of claim 36, wherein assemblingcomprises retrieving the identified image data segments from storage forassembly into the video sequence.
 38. A method of capturing videocontent of an activity subject, comprising: obtaining a set of frames ofimage data for a defined, coverage area in an activity location;determining location information identifying a plurality of locations ofthe subject in the coverage area and a time at which the subject was ateach location; for each location, selecting one of the successive framesof data corresponding to the time the subject was at that location andidentifying a subset of the image data in the selected frame thatcontains image data of the subject based on the subjects location in thecoverage area.
 39. The method of claim 38, wherein the identifiedsubsets for a plurality of the locations are assembled into a videosequence of the activity subject.
 40. The method of claim 38, whereinthe locations of the subject are determined using a tracking device thatgenerates tracking information and the tracking information is used todetermine the plurality of locations and wherein the subset of the imagedata is identified based on the tracking information obtained from thetracking device.
 41. The method of claim 38, further comprising: storingthe set of frames of image data such that pixel coordinate location canbe ascertained for image data contained therein; wherein identifying thesubset of image data comprises determining a range of pixel coordinatelocations drat contain image data of the subject in the selected framebased on the location information.
 42. A computer readable storagedevice for creating a video sequence of an activity subject, thecomputer program product comprising a computer useable medium havingcomputer program code recorded thereon, the computer program codecomprising one or more instructions for causing a processing device toperform the functions of: obtaining a set of successive frames of videoimage data of a defined coverage area in an activity location; obtainingtracking information indicating a position of the subject in theactivity location; determining a location of the subject in the definedcoverage area based on the tracking information; for a plurality offrames in which the subject is captured, determining, based on thedetermined location, a subset of the image in each of the plurality offrames that contains image data of the subject; and selecting thedetermined subset of image data in each received frame and assemble theselected subsets into a video sequence of the subject.
 43. The computerreadable storage device of claim 42, wherein determining a subset of theimage in each of the plurality of frames of video image data thatcontains image data of the subject comprises determining for each of theplurality of frames which group of pixels in the frame contains imagedata of the subject based on the determined location.
 44. The computerreadable storage device of claim 43, wherein the group of pixelscomprises an area of pixels surrounding pixels of the subject.
 45. Thecomputer readable storage device of claim 44, wherein assembling theselected subsets comprises selecting image data from each group ofpixels and assembling the selected data in a time ordered sequence. 46.The computer readable storage device of claim 44, wherein the area ofpixels is selected such that the subject image data is centered in thegroup of pixels.
 47. The computer readable storage device of claim 44,wherein the area of pixels is chosen as an area having a predeterminedaspect ratio.
 48. The computer readable storage device of claim 42,wherein each of the plurality of frames is divided into a plurality ofsectors, and determining a subset of the image comprises determining,for each of the plurality of frames, which sector of the pluralitysectors contains image data of the subject.
 49. The computer readablestorage device of claim 48, wherein selecting and assembling the subsetscomprises: selecting image data from a first sector for a plurality offrames in which image data of the subject is determined to be in thefirst sector; selecting image data from a second sector for a pluralityof frames in which image data of the subject is determined to be in thesecond sector; and assembling the frames from the first and secondsector in a time-ordered sequence.